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Abstract —In this article, two closed and convex sets for blind 
deconvolution problem are proposed. Most blurring functions in 
microscopy are symmetric with respect to the origin. Therefore, 
they do not modify the phase of the Fourier transform (FT) of 
the original image. As a result blurred image and the original 
image have the same FT phase. Therefore, the set of images 
with a prescribed FT phase can be used as a constraint set in 
blind deconvolution problems. Another convex set that can be 
used during the image reconstruction process is the epigraph 
set of Total Variation (TV) function. This set does not need a 
prescribed upper bound on the total variation of the image. The 
upper bound is automatically adjusted according to the current 
image of the restoration process. Both of these two closed and 
convex sets can be used as a part of any blind deconvolution 
algorithm. Simulation examples are presented. 

Index Terms —Projection onto Convex Sets, Blind Deconvolu¬ 
tion, Inverse Problems, Epigraph Sets 


1. Introduction 

A wide range of deconvolution algorithms has been devel¬ 
oped to remove blur in microscopic images in recent years 
Q-GD . In this article, two new convex sets are introduced for 
blind deconvolution algorithms. Both sets can be incorporated 
to any iterative deconvolution and/or blind deconvolution 
method. 

One of the sets is based on the phase of the Fourier trans¬ 
form (FT) of the observed image. Most point spread functions 
blurring microscopic images are symmetric with respect to 
origin. Therefore, Fourier transform of such functions do not 
have any phase. As a result, FT phase of the original image and 
the blurred image have the same phase. The set of images with 
a prescribed phase is a closed and convex set and projection 
onto this convex set is easy to perform in Fourier domain. 

The second set in the Epigraph Set of Total Variation 
(ESTV) function. Total variation (TV) value of an image 
can be limited by an upper-bound to stabilize the restoration 
process. In fact, such sets were used by many researchers in 
inverse problems |T 3 | , |T^-|[ 20 |. In this paper, the epigraph 
of the TV function will be used to automatically estimate an 
upper-bound on the TV value of a given image. This set is also 
a closed and convex set. Projection onto ESTV function can 
be also implemented effectively. ESTV can be incorporated 
into any iterative blind deconvolution algorithm. 
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Image reconstruction from Fourier transform phase infor¬ 
mation was first considered in 1980 ’s ED - 1 ^ and total 
variation based image denoising was introduced in 1990 ’s flSl . 
However, FT phase information and ESTV have not been used 
in blind deconvolution problem to the best of our knowledge. 

The paper is organized as follow. In Section II, we review 
image reconstruction problem from th FT phase and describe 
the convex set based on phase. In Section III, we describe the 
epigraph set of TV function. 

II. Convex Set based on the phase of Fourier 
Transform 

In this section, we introduce our notation and describe how 
the phase of Fourier transform can be used in deconvolution 
problems. 

Let Xo[ni,n2] be the original image and h[ni,n2] be the 
point spread function. The observed image y is obtained by 
the convolution of h with x\ 

y[ni,n2]=h[ni,n2]*Xo[ni,n2], ( 1 ) 

where * represents the two-dimensional convolution operation. 
Discrete-time Fourier transform Y of ^ is, therefore, given by 

Y{wi,W2) = H{wi,W2)Xo{wi,W2). ( 2 ) 

When h[ni^n2] is symmetric with respect to origin 
{h[ni^n2] = ( 0 ? 0 )) phase of H{wi^W2) is zero, 

i.e., our assumption is H{wi^W2) = \H{wi^W2)\. 

Point spread functions satisfying this assumption 
includes uniform Gaussian blurs. Therefore, phase 
of Y{wi,W2) = \Y{wi,W2)\exp{jYY{wi,W2)) and 
Xo{wi,W2) = \XQ{wi,W2)\exp{jYXo{wi,W2)) are the 
same: 

YY {wi,W 2 ) = YXo{wi,W 2 ), ( 3 ) 

for all {wi^W2) values. Based on the above observation the 
following set can be defined: 

= {x[ni,n2] I YX{wi,W 2) = YXo{wi,W2)}, (4) 

which is the set of images whose FT phase is equal to a given 
prescribed phase YXo{wi^W2). 

It can easily be shown that this set is closed and convex in 
X fQj. images of size Ni x N2. 

Projection of an arbitrary image x onto Ccj) is imple¬ 
mented in Fourier domain. Let the FT of x be X{wi^W2) = 
\X{wi^W2)\e^^^'^^''^‘^^. The FT Xp of its projection Xp is 
obtained as follows: 

Xp{wi,W2) = 


( 5 ) 
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where the magnitude of Xp{wi,W2) is the same as the magni¬ 
tude of X{wi,W2) but its phase is replaced by the prescribed 
phase function /CXo{wi,W2). After this step, [771,772] is 
obtained using the inverse FT. The above operation is im¬ 
plemented using the FFT and implementation details are 
described in Section lEl 

Obviously, projection of y onto the set Ccfy is the same as 
itself. Therefore, the iterative blind deconvolution algorithm 
should not start with the observed image. Image reconstruction 
from phase (IRP) has been extensively studied by Oppenheim 
and his coworkers |[^-p 4 |. IRP problem is a robust inverse 
problem. In Figure phase only version of the well-known 
Lena image is shown. The phase only image is obtained as 
follows: 

t, = ( 5 ) 

where IF~^. represents the inverse Fourier transform, C is a 
constant and (j){wi^W2) is the phase of Lena image. Edges 
of the original image are clearly observable in the phase 
only image. Therefore, the set contains the crucial edge 
information of the original image Xq. 

When the support of Xq is known it is possible to reconstruct 
the original image from its phase within a scale factor. 
Oppenheim and coworkers developed Papoulis-Gerchberg type 
iterative algorithms from a given phase information. In p 3 | 
support and phase information are imposed on iterates in space 
and Fourier domains in a successive manner to reconstruct an 
image from its phase. 

In blind deconvolution problem the support regions of Xq 
and y are different from each other. Exact support of the 
original image is not precisely known; therefore, is not 
sufficient by itself to solve the blind deconvolution problem. 
However, it can be used as a part of any iterative blind 
deconvolution method. 

When there is observation noise, Eq. Q becomes: 

yo = y + (7) 

where u represents the additive noise. In this case, phase of the 
observed image is obviously different from the phase of the 
original image. Luckily, phase information is robust to noise 
as shown in Fig. which is obtained from a noisy version 
of Lena image. In spite of noise, edges of Lena are clearly 
visible in the phase only image. Gaussian noise with variance 
(7 = 30 is added to Lena image in Fig. 

FTs of some symmetric point spread function may take 
negative values for some {wi^W2) values. In such {wi^W2) 
values, phase of the observed image Y{wi^W2) differs from 
X{wi^W2) by TT. Therefore, phase of Y{wi^W2) should be 
corrected as in phase unwrapping algorithms. Or some of the 
(tui, 7172) values around (rci, W2) = ( 0 , 0 ) can be used during 
the image reconstruction process. It is possible to estimate the 
main lobe of the FT of the point spread function from the 
observed image. Phase of FT coefficients within the main lobe 
are not effected by a shift of tt. 

In this article, the set will be used as a part of the 
iterative blind deconvolution scheme developed by Dainty et 
al and together with the epigraph set of total variation function 
which will be introduced in the next section. 



(a) 




(c) 

Fig. 1 : (a) noisy “Lena” image, (b) Phase only version of the 
“Lena” image, and (c) phase only version of the noisy “Lena” 
image. 

III. Epigraph Set of Total Variation Function 

Bounded total variation is widely used in various image 
denoising and related applications |T^ , |T7| , p6|-p9|. The 
set Ctv of images whose TV values is bounded by a prescribed 
number e is defined as follows: 

Ctv = {x : TV(x) < e}, ( 8 ) 

where TV of an image is defined, in this paper, as follows: 

M M 

TV(x) = - x^’^l + Y (9) 

i,j=l i,j=^ 
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This set is closed and convex set in ^ ^^n be 

used in blind deconvolution problems. But the upper bound e 
has to be determined somehow a priori. 

In this article we increase the dimension of the space by 
1 and consider the problem in M^ix^ 2 +i define the 
epigraph set of the TV function: 

Cestv = {x = [x'^ I TV(x) < z}, (10) 


where T is the transpose operation and we use bold face letters 
for N dimensional vectors and underlined bold face letters for 
+ 1 dimensional vectors, respectively. 

The concept of the epigraph set is graphically illustrated in 
Fig. Since TV(x) is a convex function in 
Cestv is closed and convex in M^ix^ 2 +i ^q. (10) one 


does not need to specify a prescribed upper bound on TV of an 
image. An orthogonal projection onto the set Cestv reduces 
the total variation value of the image as graphically illustrated 
in Fig. [^because of the convex nature of the TV function. Let 
V be an X A ^2 dimensional image to be projected onto 

the set Cestv • In orthogonal projection operation, we select 
the nearest vector x* on the set Cestv to w. The projection 
vector X* of an image v is defined as: 


w = arg mm ||v — w|| 

wG Cestv 


( 11 ) 


where v = [v^ 0]. The projection operation described in (11) 
is equivalent to: 


II, (12) 


where w* = [wJ,TV(wp)] is the projection of (v, 0) onto the 
epigraph set. The projection w* must be on the boundary of 
the epigraph set. Therefore, the projection must be on the form 


Wp 


V 


w 

TV(wp)_ 

= arg nun II 

wGCf 

0 


TV(w) 


[wJ,TV(wp)]. Equation (12) becomes: 


w = 




TV(w^)^ 


= arg min ||v — w ||2 + TV(w)^. 

wGCf 


(13) 


It is also possible to use ATV(.) as a the convex cost function 
and Eq. p3] becomes: 


= arg min ||v — w ||2 + A^TV(w)^. (14) 

wGCf 

The solution of ( pT) c an be obtained using the method that we 
discussed in |28|, |30|. The solution is obtained in an iterative 
manner and the key step in each iteration is an orthogonal 
projection onto a supporting hyperplane of the set Cestv- 
In current TV based denoising methods in), the 
following cost function is used: 

min||v — w ||2 + ATV(w). (15) 

However, we were not able to prove that p~5] corresponds to a 
non-expensive map or not. On the other hand, minimization 
problem in Eq. •ED and O are the results of projection 
onto convex sets, as a result they correspond to non-expensive 
maps 0, (ig, 0 ,0 -p7|. Therefore, they can be 
incorporated into any iterative deblurring algorithm without 
effecting the convergence of the algorithm. 




TV(Wp)^ 



Eig. 2: Graphical representation of the orthogonal projection 
onto the set Cestv defined in O- The observation vector 
y = [v^ 0]^ is projected onto the set Cestv ^ which is the 
epigraph set of TV function 


IV. How TO INCORPORATE CestV AND C^fy INTO A 
DEBLURRING METHOD 

One of the earliest blind deconvolution methods is the 
iterative space-Eourier domain method developed by Ayers 
and Dainty p^ . In this approach, iterations start with a 
Xo[n] = Xo[ni,n 2 ], where we introduce a new notation to 
specify equations [n] = [ 711 , 722 ]. Eor example, we rewrite Eq. 
Q as follows: 

y[n] = h[n] ^ Xo[n], (16) 


The method successively updates h[n] and x[n] in a Wiener 
filter-like equation. Here is the step of the algorithm: 

1) Compute Xi{w) = X{xi[n]}, where T represents the 
ET operation and w = {wi,W 2 ), with some abuse of 
notation. 

2) Estimate the point-spread filter response using the fol¬ 
lowing equation 


Y{w)X*{w) 


(17) 


where a is a small real number. 

3) Compute hi[n] = T~^{Hi{w)} 

4) Impose the positivity constraint and finite support con¬ 
straints on hi [n ]. Let the output of this step be hi [n ]. 

5) Compute Hi{w) = X{hi[n]} 

6) Update the image 




yymiw) 

\Hi{w)\^ + a/\Xi{w)\y 


(18) 


7) Compute Xi[n] = X~^{Xi{w)} 

8) Impose spatial domain positivity and finite support con¬ 
straint on Xi[n] to produce the next iterate Xi-^i[n]. 

Iterations are stopped when there is no significant change 
between successive iterates. We can easily modify this algo¬ 
rithm using the convex sets defined in Section 0 and|III| We 
introduce step 6-a as follows: 

6-a) Impose the phase information 


Xi{w) = 


(19) 
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where /Y{w) is the phase of Y{w). This step is the pro¬ 
jection onto the set As a result step 7 becomes Xi[n] = 
We also introduce a new step to Ayers and 
Dainty’s algorithm as follows: Project Xi[n] onto the set Cestv 
to obtain x^+i[n]. The flowchart of the proposed algorithm is 
shown in Fig. 

Since the Alter is a zero-phase Alter in microscompic 
image analysis h[ni,n 2 ] = h[—ni,—n 2 ] = h[—ni,n 2 ] = 
h[ni, — 772 ] this condition is also imposed on the current iterate 
in Step 4. 

Global convergence of Ayers-Dainty method has not been 
proved. In fact, we experimentally observed that it may diverge 
in some FL microscopy images. Projections onto convex sets 
are non-expansive maps p7| , | [40| , therefore, they do not 

cause any divergence problems in an iterative image debluring 
algorithm. 


In another set of experiments, we used the FL image shown 


in Fig. 6a which is blurred by an unknown Alter or captured 
with a focus blur ED- This image is deblurred using the 
blind deconvolution by phase information and its output is 
compared with Ayers and Dainty’s and Xu et aPs algorithm 
Q. The deblurred image using the blind deconvolution by 
phase information and Cestv , Ayers and Dainty’s algorithm, 
and the Xu et aVs algorithm are shown in Fig.|^|^ and[6d| 
respectively. 

Ayers and Dainty’s method does not converge as shown in 


Fig. Xu et aVs algorithm also diverges when we select 
“default” option. It does not diverge when we select “small” 
kernel option but the result is far from perfect as shown in 
Fig. Sets C(f) and Cestv can be also incorporated into Xu 
et aPs method for symmetric kernels but we do not have an 
access to the source code. We get the best results when we 



These images are blurred by Gaussian Alter with disc sizes 
d = 5,10, and 15 and cr = 1, 2, and 3. The blind deconvolu¬ 
tion results are presented for a = 1, 2, and 3 in Tables Di 
and|^ respectively. 

In Tables BE and m bold font is used for the highest 
PSNR. Clearly, the modifled deblurring method using and 
Cestv produces better PSNR values in almost all cases. 

Four sample of images used in this set of experiments are 
shown in Fig. As an example, the Im-11 shown in Fig. 
in is blurred using Gaussian Alter with d = 5 and a = 3. 
The blurred image is shown in Fig. The deblurred image 
obtained using the proposed algorithm and Ayers and Dainty’s 
algorithm are shown in Fig. and 1^ respectively. 


Fig. 4: Sample florescence microscopic images used in exper¬ 
iments (a) Im-5, (b) Im-7 (c) Im-10, and (d) Im-11. 


VI. Conclusion 

FT phase and the epigraph of the TV function are closed 
and convex sets. They can be used as a part of iterative micro¬ 
scopic image deblurring algorithms. Both sets not only provide 
additional information about the desired solution but they 
also stabilize the deconvolution algorithms. We experimentally 
observed that they signiflcantly improved the deblurring results 
of Ayers and Dainty’s method. 
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TABLE I: Deconvolution results for florescence microscopic images blurred by Gaussian filter with disc size d and a = 1. 
PSNR (dB) values are presented for the proposed algorithm and Ayers and Dainty’s algorithm. 


Method 

Filter radius 

Im-1 

Im-2 

Im-3 

Im-4 

Im-5 

Im-6 

Im-7 

Im-8 

Im-9 

Im-10 

Im-11 

Im-12 

Im-13 

Im-14 

Ayers 

d = 5 

5.39 

17.98 

6.13 

9.20 

8.22 

5.52 

12.31 

7.52 

6.79 

5.67 

6.53 

13.34 

14.49 

8.13 

Modifled 

d = 5 

9.16 

11.00 

10.36 

11.80 

9.85 

10.37 

16.49 

8.90 

10.86 

8.47 

10.34 

16.72 

17.48 

10.68 

Ayers 

o 

II 

4.57 

5.25 

5.12 

8.70 

7.61 

10.93 

13.51 

6.52 

7.70 

5.96 

6.44 

10.17 

16.80 

7.53 

Modifled 

o 

II 

11.14 

9.41 

9.81 

11.61 

9.96 

12.80 

16.04 

9.45 

11.45 

16.43 

11.71 

15.42 

18.14 

11.37 

Ayers 

d = 15 

4.94 

5.30 

5.90 

7.81 

6.33 

7.76 

11.49 

8.47 

5.56 

4.01 

6.38 

10.23 

18.67 

7.22 

Modifled 

d = 15 

9.00 

10.60 

11.51 

12.04 

10.31 

10.49 

14.16 

10.72 

10.99 

7.83 

9.49 

15.65 

17.69 

10.71 


TABLE II: Deconvolution results for florescence microscopic images blurred by Gaussian filter with disc size d and a = 2. 
PSNR (dB) values are presented for the proposed algorithm and Ayers and Dainty’s algorithm. 


Method 

Filter radius 

Im-1 

Im-2 

Im-3 

Im-4 

Im-5 

Im-6 

Im-7 

Im-8 

Im-9 

Im-10 

Im-11 

Im-12 

Im-13 

Im-14 

Ayers 

d = 5 

6.37 

6.92 

7.03 

8.10 

9.08 

8.69 

15.64 

8.44 

10.17 

14.19 

10.98 

16.28 

22.95 

11.41 

Modifled 

d = 5 

17.24 

12.61 

11.79 

12.08 

12.82 

10.36 

18.81 

12.36 

9.38 

13.20 

8.40 

16.66 

17.07 

13.27 

Ayers 

d = 10 

16.36 

7.04 

8.04 

9.63 

24.20 

10.58 

19.26 

9.58 

16.78 

8.07 

6.57 

18.63 

22.35 

15.21 

Modifled 

d = 10 

15.30 

13.01 

12.58 

11.86 

16.86 

16.33 

20.44 

11.61 

10.47 

14.18 

11.74 

22.17 

21.66 

18.39 

Ayers 

d = 15 

10.52 

13.85 

12.71 

14.85 

13.49 

15.64 

18.38 

9.01 

7.20 

7.10 

6.35 

22.07 

19.60 

13.48 

Modifled 

d = 15 

20.96 

11.70 

16.14 

12.99 

20.76 

19.80 

21.23 

15.08 

11.42 

13.84 

12.32 

21.91 

23.05 

18.12 


TABLE III: Deconvolution results for florescence microscopic images blurred by Gaussian filter with disc size d and a = 3. 
PSNR (dB) values are presented for the proposed algorithm and Ayers and Dainty’s algorithm. 


Method 

Filter radius 

Im-1 

Im-2 

Im-3 

Im-4 

Im-5 

Im-6 

Im-7 

Im-8 

Im-9 

Im-10 

Im-11 

Im-12 

Im-13 

Im-14 

Ayers 

d = 5 

7.40 

6.33 

6.39 

7.43 

6.51 

9.39 

15.92 

7.20 

6.35 

6.71 

6.62 

17.47 

22.19 

8.88 

Modifled 

d = 5 

8.08 

23.06 

17.18 

22.16 

11.66 

23.18 

21.75 

23.83 

20.26 

23.20 

30.91 

17.77 

23.59 

8.91 

Ayers 

d = 10 

8.80 

20.03 

14.95 

16.08 

22.06 

22.57 

21.18 

22.97 

17.39 

22.03 

32.26 

21.55 

24.74 

20.89 

Modifled 

d = 10 

8.02 

25.66 

24.74 

26.44 

24.15 

29.61 

23.99 

24.44 

20.67 

26.04 

39.92 

24.03 

27.05 

27.30 

Ayers 

d = 15 

18.29 

28.88 

14.36 

18.77 

27.50 

27.54 

24.15 

24.91 

21.64 

26.09 

34.00 

22.60 

23.69 

26.76 

Modifled 

d = 15 

23.86 

28.62 

32.23 

28.55 

36.93 

27.80 

24.31 

24.33 

21.34 

29.63 

40.84 

23.16 

27.44 

35.31 
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(c) (d) 


Fig. 6: The deconvolution results for FL image downloaded from |http://bigwww.epfl.ch/algorithms/mltldeconvolution/| (a) 
blurred image, (b) deblurred by the blind deconvolution using phase information, (c) deblurred by Ayers and Dainty’s algorithm 
(PSNR = 34.00 dB), and (d) Deblurred by Xu et al’s algorithm 0. 













